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ABSTRACT 

This commissioned paper examines the National 
Assessment for Educational Progress model for citizen^. Ip and 
suggests an alternative model oriented more directly to educational 
and political goale<, In the current model performances 0!i the 
citizenship exerciser can only be interpreted by the population 
characteristics of age, sex, parental education, race, region, size 
and type of community. The structural emphases of the model on 
population characteristics, rather than on the interactions of 
individuals with different environments, induces thinking in 
stereotypic terms. The basic question should be not who are good 
citizens, but what are the conditions that contribute to good 
citizenship. Data results in the age categories indicate a general 
tendency for the percentage of acceptable responses to increase with 
age, which denies Bruner*s concept that anything could be taught in 
some honest way at any age. At the same time the model must recognize 
the identities and priorities of different social and ethnic groups 
which might contribute to differences in cognitive and affective 
development. The current model also ignores the differences in school 
environment. An alternative model would compare schools, programs, 
classroons and take into account person«environment interactions and 
social and ethnic group gos^ls. (DE) 
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ON THE NEED FOR CRITERION REFERENCED 
RESEARCH AND DEMONSTRATION t A REACTION TC THE 
MODEL OF NATXGNAL ASSESSMENT IN CITIZENSHIP 

Joseph C, Grannia 
Teachers College » Colunbis Univessity 

In this paper I vant to underscore first of all two 
related weanings of thr terw -model #*• one enphasiaing the 
structture of what is represented by a sKKSel* and the other 
stressing the phenomenon of influence* Next^ I vould like 
to note the potential interplay between these two aspects 
of the National AsaessMsnt nodels with ceference particu- 
larly to possible interpretations of hhe data in Citizen- 
ship Reports 2 and 9. Last I shall suggest an alternative 
to National Assess»ent» talcing note of the gains National 
AssessMmt may have mdm, but at the sawe tine otienting 
still Mre directly to educational and political goals » in 
this case to the fostering of citisenship. 

X« tTF ^!|tienal Assess»»nt Model as Representation yid as 

This paper will dwell upon the obvious, and the dis- 
tinction to be aade hare is no exception. Taylor's paper 
describing the National Assessnent nodel and its uses 
itself points to both the representation and influence as- 

Baylor* Bob L,, "Potential Uses of the National Assessment 
Model at the State and Local Levels, •* university of 
Colorado, September, 1973* 
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pects of nodeling. Thus ny etatting point is one of clari- 
fying what he has written* 

When ve speak of the ''model** of National AssessK^ent 
we cefer partly to citone representation of its basic eompo- 
nents and their articulation, Taylor *s Diagram Z describes 
a succession of steps in the develop«ent» adndnistxation* 
and disseaination of the National Assessment instruments 
and findings. The multiple connections drawn in the diafrara 
ssfgest complications in this process » as the first-cycle 
sampling plan was modified in anticipation of scoring and 
analysis* exercise development looked forward to the utili- 
zation Of information* etc.* and as these steps might be 
repeated in successive cycles. 

Diagram I spells ot£t* or differentiates* on;,y steps 
of special concern to the assessor, A different diagram 
might elaborate the process between dissemination* utiliza- 
tion* and the redevelopment of 6bjeetives* suggesting dif- 
ferent channels of national* state* and local dissemination* 
different uses of the assessment information as a function 
of different resources at these levels* and so on, Taylor's 
diagram reflects the putative neutrality of National Assess- 
ment vis-a*^is the uses of the assessment information. In 
various passages Taylor does suggest that this information 
calls for research* that it will be interpreted differently 
at state and local levels* and that it will lead to inter- 
ventions in different spheres* economic* curricular* and 
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•o forth. StilXt it is the basic stance of National Assess- 
nent that these things be left to othess to vorK out. From 
this standpoint Diagran X represents the National Assessiaent 
process accurately. 

But a model is nwer neutral, whether it has been 
dnnm in physics or in politics and educ^itionp a model 
Models a process of thought and action. In this simplistic 
vay one can argue that what National Assessment aodels is 
assessment , and that complementayy processes directed to 
changing what is assessed vill be more an indirect* than a 
direct t result of National Assessment. It is not a trivial 
observation that tl-m uses of National Assessment have in 
fact been, as described by Tpylor* further assessment at the 
state and local levels. National Assessment's powerful 
coordination of money and teclnical expi^rtise with academic 
and political judgment partly accounts fos: this imitation. 
Equally* however, it is the specificity of the model with 
respect to certain processes, and its lac^ of specificity 
with regard to others, that accounts for the imitation. 
Indeed, National Assessment itself can be said to be an imi- 
tation of a process that has been most infltiential in 
American education in recent decades* the testing of indi- 
viduals for purposes that are a great deal more diffuse 
than the testing operations j2b£ i£.'' The criterion refer** 
encing of the National A^isessnent exercises might be seim 

^ White* ftary Alice and Jan ^uker, **Model8 of Schooling and 
Models of Evaluation,** Teachers College Recporc^ . H, 
February, 1973, 293-307, maKes the connection between 
testing and selection* a relatively diffuse, if still 
Q connequential process. 

ERIC 
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ai a movtt beyond testing for its cm or beyond the 

perallel purposes of grading add selection associated with 
norm referenced tests. Whether this sKSVe is realised, how 
ever, and the testing thus does not ag4in become sn end 
in itself, depends on other processes that the National 
Assessnent «odel does not explicate st present. If the 
assessment is supposed to be linked wore closely to teach- 
ers' accountability than it has been in the pest, there 
remins the risk that accountability vill be displaced 
upon the population tested. 

Let Me now repeat this argument at another level of 
what is modeled by National AssessKsnt, its representation 
of what eitisenship is and how one goes about observing 
and explaining its occurrence or nonoccturrence. Reasoning 
siMplistically again, let us first suppose that acceptable 
perforwances on the National Assessasnt citizenship exer- 
cises the criteria of citisesiship, 1. &. » that we 
would ssy soaeone ii a good citizen if s/he perform in 
acceptable war« on the test, analogously to our saying 
that siteone « a good diiver if s/he passes a driving 
test.^ HOW does National Assesaiwnt allow us to explain 
the occurrence or nonoccurrence of these performances? 
Age, sex, parental educaticjn, color, and locaticn by region ^ 
or sise and type of coiwwnity are the only variables that 
are systematically boought to bear on this question. 

Siis analogy is drawn, with much the same tette*, in 
White, Naomi, -Sbatiewide Testing Leglislaticsi for 
Minimal Skills i An Exploraticn of Some 
^ Educational Policy Research Center, Syracuse Uhi- 

ERJC versity. May, l«73. 
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One night conjecture thit age represents different degrees 
of exposure to citixenship eduesticn* but whether it is 
explicit or ieplieit* or ifhether it stem from school* 
television, or comunity, defies conjecture except on a 
•ost Ji2£» exercise-by-«xercise basis* Sex might relate 
to role opportunity* parental educfttion to kinds of dis- 
course in the home* color to an 1 individual's tr^atmimt by 
others* and location to comsnanity needs and resources i but 
then we could scramble all of these conjectures toot* 
given the lack of specification of what the varibbles link 
vith. What ve are led then, if onlT by default* is an 
emphasis on the por ilation char acteristics themselves as 
explaining acceptable and unacceptable citizenship Ptrfgy- 

Caplan and Nelson^ reported recently that* of 69 
data -based* psychological rese&rch studies of blacks that 
were abstracted in the first sjIx months' of the 1970 Psj:- 
choloaical Abstracts . 82% were person -centered and only 
18% situation- or environnent-centeved in their causal 
attributions. By far the largest category of variables 
Caplan and Nelson included under the heading **person 
centered** was **group meidbership {fn* ^iack or white )"» 
which included 48% of all the 69 studies. Person-centered 
categories* the authors observe* are more available and 
more easily exploited than situational or environaental 

^Caplan, Nathan and Stephen Nelson* •*0n Being Useful*** 
American PsYcholoaist , March 1973* 199-211 • 
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categories. Discussing a variety of questions such as 

achievenent activation vs. the structure of the economy as 

causes of uneniploywent, Caplan and Nelson concluded » 

Whether the social problem to be attaciJced is delin- 
quency, snental health, drug abuse, unemployment, ghetto 
?iot8, or vhatevdr, the significance of the defining pro»^ 
cess .Is the sanei the action (or inaction) taken will 
depend largely on whether causes are seengas residing 
within individuals or in the enviroiuiient. 

Are we not dealing with a similar phenomenon? The 
effect of not specifying what age, sex, parental education, 
color, and location mean experientially is our attribution 
of good and bad citizenship to these qualities £££ s^. 

The National Assessment citizenship reports do specu- 
late at certain points about the meaning of the population 
variables. The following excerpts from Report 9 illustrate 
the tentativeness with which this is donet 

Thirteen-year-aids in the Grade School group showed 
the greatest deficit of any gropp— 10%-- on the racial atti- 
tude mercises. Their responses to several questions 
describe where some of the deficits occurred, but don't 
explain why.... Perhaps as higher and higher proportions 
of the population get a high school educatdKwi, the smaller 
proportion who do not become mo»e distinctive in certain 
ways (ft. a«» accepting of other races).' 

Are Bla.slt youngsters less willing to tell a non-BlacX 
interviewer what they believe about racial discrimination? 
Or are they re.^lly less aware of racial discrimination 
than other 13-year-«lds? The balanced results on these 
questions show smaller deficits (by at least half) than do 
the observed results, as we discussed earlier in this 
chapter (see page 51). At least one of the other charac- 
teristics on which the results are balanced is thus asso- 
ciated in son© way with the results reported for Blacks. 
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For exmnple, perhaps the disproportionate niuBber of Blacks 
whose parents h^ve little education hear less discussion 
about acts of n cial discri»ination in the world*^ 

These and a doten similar ly limited speculations aside, 
the »ain tendency in the reports is to leave the findings 
to explain thewselves. Presuaably research to be designed 
and conducted toy other agencies will lead to the development 
of irtferventions that will in turn result in changes in the 
assessment results the next time around. What nay defeat 
this, however, is the psycho-logic of the model. The struc- 
tural emphasis of the model on population characteristics, 
rather than on the interactions of individuals with differ- 
ent environments, induces thinking in these same stereotyp- 
ing terms by those vho receive the assessment reports. 

The language of the citizenship reports consistently 
reinforces stereotyping! 

The two upper levels of parental education, particu- 
larly the Beyond High School group, excelled, as usual 

The typical perforwance of Bladks at all four ages 
fthovs deficits of about 99^ on all Citizenship results com- 
bined 

The general picture is for performance on this goal to 
folic that on all Citizenship results fairly closely* 
Thus the Extreme Rural and Extreme Inner City respondents 
shoved the greatest deficit in relation to the nation as a 
whole, and the Extreme Affluent Suburb respondents showed 
the greatest advantage* 

^ttJJUk p. 57^ 
37. 
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Of cour««, thi«8 i« all very ironic. The reports fea- 
ture as many exceptions to the general trends as they can 
find, and the avoidance of «iecua»ing the significance of 
the general trends is presiamably calculated not to risk 
Offense. But the patterns in the test results that are 
associated with the populatioi variables are clues to 
individuals • Interactions vith their environnents . That 
our thinking cannot afford to rest with these clues is the 
thiiust of the next section of this paper. 

The last point to be Biade in this opening argument 
returns to the analogy between a citizenship test and a 
driving test. Si»plistically again, we have to notice 
that National Assessment presents what individuals sax i" 
response to various paper and pencil, interview, and dis- 
cussion tasks as the basic model of what constitutes citi- 
Eenship. Who can doubt that many mere individuals know or 
will say that they should vote than actually vote in any 
election in this country, national, state, or local? Or 
that 5*ore believe they should oppoae ' discrimination in a 

park, and can say how to do so, than are likely to put 

12 

this belief and knowledge into pracjtice? Kohlberg has 
emphasised Hartshorn and Mays classic failure to find 
differences between delinquents' and nondelinquents* 
knowledge of •♦right" and -wrong" actions, and has stcessed 
instevJ the developmental level of the individual's justi- 

^^Xherq, Lawrence. "The Develi)P«ent of C|U^ 

entation toward a Moral Order,** YJ^ Humiift . j^ , 1963 » 
Pt» 11-33 • 
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fication cyf right and vrong. Kohlberg thus improves his ca- 
pability of a«80ci*ting »orai discourse with »or«l behavior, 
and, analogously, ve might come closer in this way to asso- 
ciating citizeriiihip discourse with citizenship behavior , 
The developmental approach, however, still leaves questions 
unanswered. Is it possible that those with -higher** levels 
of looral discourse are wore capable of rationalizing their 
morality and immorality, and thereby more readily escape 
toeing branded delinquent or criminal? Our increasing aware- 
ness of -white cellar- or copporation and political crime 
certainly gives credance to «iis <i(uestion. Again, is it 
possible that diffeeent styles of language and discourse 
associated with socio-economic or racial/cultural different' 
ces affect the response of an individual to a verbal repre- 
sentation of a moral, or let us say a civic, problem, and 
affect equally an examiner •s interpretation of the respoiise? 
Here the questions we are raising with relation to what is 
imown or stispected about moral judgment lead into the more 
general area of performance in a culturally standard verbal 

situation, in this case the formats that link testing and 

13 

schooling so closely with each oth«r. Labov's finding 
that the task of talking to kf;ep a rabbit from getting ner- 
vous (O elicited much more talk from children who spoke 
Black English than questions addressed to the children by a 
sympathetic Black interviewer illustrates this concern. 

^^Labov, William. -Academic Intelligence and Black Intel- 
ligence*** Atlantic Monthly . J\me 1972, vol. 229, 
No. 6, pp. 59-67. 



BEST mn mm\£ 

10 

Coulii All thisB ruftve aiKy bearing on vho tends to "exhibit" 
.'.'.I'^te '"Imoy'i^dg'B and behavior considered desirable for citi- 
i^-'.-nfi- in our acciety"? Suppose ths test was c»\e of integrat- 
.v.<5 % 7).ei<3hborhood» a bas» or a limch counter » or that it 
'..ne challenging a school tauzeaucracy, or that it involved 
'lirlnci or ^^orlting or playing or generally living with somew 
or.';? who Viad been in jail, as oppoaed to saying how one would 
/io any of these things? 

Part of what io at stake here is the relevance of the 
tmo^'l'p'dge recmired by the assessment to the particular con- 
'vpxt3 in which different individuals enact their citizen- 
shipv This question applies not only to» say, who is wore 
likeJi/ to bfc oriented to the coutts as an institution for 
;?ettling disputes alxnat aacney, bu.t who is more likely to 
tiMSi accept YScttttosro Hind c!!ttntifiitt iit k dif f«irent color 
irom ona'ti self (just to indicate that the question can cut 
C'Cfth ways i ) Presuatably the task force which is looking 
into the validity of the assessment exercises is consider- 
ing this issue » What I would *apliasize here is that the 
■'2.s£i&&Bmint is uor® likely to have content validity to the 
extent that it includes tiie eftactsiB nt of citizenship in 
qciul ra-late-^jl co« texts. This then connects with the other 
>mrt of what is at issue, the format or structure of the 
setting in whix2h citizenship is to lb© observed, which on 
linguiiiiitic groitmds alone, as x have tiled to argue above, 
v.a Biore likely to be valid as it is oriented to a citizen- 
ship goal* i. a. * to a citizenship goal other than accept- 
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Hot to mention how the atjsfesament'ss having acceptable 
and imacceptabl€ responses for each and every exercise con- 
tiiUites to the c^Xtural standardiisation of "advantages" 

and "deficits"! 

All of the above »ight seem to show that I have no use 
fior inforaation about what individuals say, or that I think 
differences would t-anish if enactwent, instead of saying » 
was assessed. Actually, I would like to knov about bfith 
enactaient and saying, or thekno^ledge and feeling saying 
represents. The National Assessaient exercises do in fact 
include self reports of enactsaents, but, even accepting the 
reliability of self reports, these are still no more reveal- 
ing in arid of themselves than are sheer statements of know- 
ledge und feeling. How knowledge and feeling facilitate 
or inhibit enactment is a question that especially conceuns 
ediicators, along with how situational conditions facilitate 
or inhibit enactment. Does the civics text knowledge 
represented by many of the exercises contribute to effec- 
tive acticTi in &om political situations and ineffective 
action in othess? Or, to rephraie a different question 
a«ked in Report 9, what rules make most sense to different 
individuals participating in a coKaoon task? 

I^t us state the basic question still more generally. 
It is not who are the good citizens, biit what are the condi- 
tions tnat contribute to good citizenship. Because National 
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Xai8««»i»«nt is not designed to answsr this question, hovever 
jmich it vmy spffculate about it fi2t.J22al tncto. National 
Assessttsent do«« not «od«l asWfcng the question. We will now 
proceed fuirther into the logic and psychologic of the pjcob- 
le» this presents. 

II. fh^ L>toanina <?-i ttitterna in th^ National Assessisgnt 
findings . 

The National Aasessnent reports tend to discuss the 
explanations of specific anowolies associated with one or 
another exercise, but they avoid discussing the weaning of 
the larger patterns that hit the reader full in the face. 
Here we shall take note of the soae of the difficulties 
these larger pattema present. Our approach to this will 
be naive. We shall first orient to the data itself, asXing 
wh«t the r>«ttems aight be liXely to suggest to the reader. 
Then we sh?,tll just begin to sort out sow of the factors 
that are confused in the^se pattusmc, raising questions for 
an alternative |is»f»«» of research and demonstration. 
A. jte, ^fll»'ifft>le in Citize nship ^igrfor jaagfe. 

In Report 2, straight percentages of correct or accept- 
able responses at different age levels are shown for each 
exercise dipcmAsdacm. Thus the following results are exhi- 
bited x 

Report that the police do not have the 9 13 17 Adult 
ri«ht to coae inside one's house at 

any time they want and can give as a ^0% 68% 90% 83% 
reason legal guarantees, or reasons 
concerning privary and permission of 
oceiuoant to enter (in own words ).^'* 
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State that our legal ayetew (covirts, 
laws) is the means provided by 
goveminsnt iox: settling an argu- 
ment over money. 

Last names of the persons now hold- 
ing those offices*,,*} 
President (Nixon) ^ 
Vice President (Agnew)^» 



Could give at least 
what fighting wap 
named* 





17 


Adult 


50% 


70% 


87% 


13 


17 


Adult 




97% 


98% 




75% 


87% 


13 


17 


Adult 


53% 


66% 


77% 


27 


44 


55 


11 


24 


31 


3 


12 


16 


1 


4 


7 


13 


17 


Adult 


64% 


88% 


92% 



1 explanation of 
about in co\mtry 

2 explanations 

3 explanations 

4 explanations 

5 explanations^' 

Opportunity to read a greater varie- 9 
ty of viewpoints and information 
was stated as a reason why it 
might be good to have newspapers 
in a city written and printed by 
more than one company* 

AS these examples illustaate, the general tendency in 
th« data is for percentage of acceptable response to in- 
crease with age. though with some reversals between age 17 
and adult* This trend is alluded to in various specific 
contexts in Repott 2, for example in the following comment! 

As seen above, adults consistently showed more Know- 
ledge about current conflicts than did the other ages* 
When asked in Exercise F4 to name some ways to avoid war, 
however, fewer adults than IVn and 17 named 
one way (77% of 13«si 88% of 17«si and 65% of adults). 
Even 9-year olds approached the adult ' 
60% giving at least one way to avoid ^•'^^^f^*^^* J.^ 
one explanation is that the adult view of the possibility 



^"^Campbell, Vincent N*, si fti» RgjasRl 2 , cit igepghip > 

Na ttoaal Results # Education Commission of the States 
Nitimlal Assessment of Educational Progress, Denver, 
Colorado, November, 1970, p* 30* 
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Ibid ** p. 41* 
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of avoiding «imf lict is both wore sophisticated and wore 
-jaundiced** I a larger nuaber of adults indicated that they 
felt war to be unavoidable and a larger nunber at the 
younger ages gave simplistic, but acceptable answers ("atop 
fighting"). 

The numbers wh i gave at least three ways to avoid war 
rtenonstrates the m>£m usual age trend of an increase in 
achievement up to age 17 with minor differences between 
17»s and adults (5% of 9»sf 12% of 13»8| 32% of 17*8| and 
25% of adults). A similar 9 to 13 age trend is shown in 
Exercise P5 which supposes competition between the U. S, 
and Russia concerning territorial rights on Mars, Almost 
twice as many 13* a as 9»s (75% vs, 45%) stated that the 
U, S, and Russia should discuss and settle these matters 
before men land on Mars,^^ 

Notice that in the discussion above, as is the case 
elsewhere in the report, it is the departure from the -more 
usual age trend** that se^ms to call for explanation. How 
does one account for the main trend itself? Leaving aside 
for the present a consideration of how the exercises were 
constructed in relation to age expectations, and assuming 
the content or goal referenced validity of the exercises, 
the conclusicntthat best fits the pattern in the results is 
that tliey reflect maturaticn and/or the general accumula- 
tion of Xnowledge and experience with age. This is obvi- 
ous, is it not? (And I did warn that this paper would 
dwell upon the obvious,) 

what is less obvious is the significance of the con- 
clusion for citisenshjftp education. Many, but probably not 
all readers of this paper will be sware that nockkl studies 
educators in the 1950 's (I choose this date for ccmvenien- 
ce cf discussion) had occasion to assess the significance 



Ibid ., p, 84, 
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of similar findings atising out of a number of fcurveys of 
children's social r ncepts conducted during the Pro|>ressive 
Education erat Meltzer* 1925 i Lacey* 1932 i Peessey, 1934 t 
Eskridge, 1939i Ordan, 1945| and Bates, 1947, to na»e those 
I am aiost familiar Yith*^^ All of these studies included 
Elementary school pupils at different grades, and several 
of them included secondary school pupils as veil* All 
tested childrmn*s attainment of the correct or conventional 
meanings of social concepts at different ages, and all 
found progressions in corrett attainment vith increasing 
age. Interestingly, only elementary social sdudi^mteduca- 
tors, vith the exception of Wesley and Wronsltei^^ (Wesley 
himself ims author of a Wsst of Social Terms'* in 1932^^ J, 
paid attention to these findings, directly or indirectly, 
to ijudge from a comparison of elementary and secondary 
social studies methods texts of the 1950«s. At least in 
the decade before the impact of sputnik, Bruner, and the 
structure movement in tiwrd:Qml:teviifti was elementary educa- 
tors who vere more concerned with the development of Imov- 
ledge over time or age, while secondary educators focused 
on its acquisition ^% • given time or age. 



^^Meltzer, H, , -Children's Social Concepts i A Study of 

Their Nature and De*''elopment,*' IfiMil* CoU . gffljl* 
Edl^., NO. 192, 19251 Lecey, JoynM., -Social fitudies 
Concepts of Children in the First Three GradeB,- 
Seach. eoU. QsmXt- mSL*» no. 548, 19321 Pressey, L. 
C, -tA Study in the Learning of the Fundamental 
Special vocabulary of History from the Fourth Through 
the Twelfth Grades,- Truman L. Kelley and A. C. Krey, 
«ds. , 'SlsSM. Measurements ia ^ Socifii S£iSQ£SS.* 
New York, Scribemer's, 193*», 155-2181 (continued on 
page following) 
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But which emphaaia was correct? The elementary educa- 
tors stressed a progression of learning from concrete to 
abstract, the necessity of building up manifold experiences 
with the referents of a concept, and the importance of tea- 
chers* avoiding empty verbalisms and premature formaliza- 
tion. What precipitated out of this, however, was such an 
emphasis on accomodating to the presumed -natural- pace of 
concept attainment reflected in the progressions of attain- 
ment with age, that Bruner's declaration that anything could 
be taught in some honest way at any age, hedged though it 
was in Piagetian conditions, came as a shock, particularly 
to elementary educators. 

None of the social concept studie s cited above, nor 
j^n y others conducted ir > the rear s before 1956. tried to 
assess ehii dr yn's eapa ^ ^iitv of learning a gonygpt ^t a 
< ^^ven age Vy avstemat.^ r* U y ff »*^>" P<^inq to teach the goncs fit 
to children . Lacey did int«pret an observed acceleratiurt 

Eskridge, T. J., Jr., -Growth in Understanding of Geo- 
graphic Terms in Grades IV to VII,- ms. ]^'JSS^ 
Stud , fisias. • NO. 4, Durham, North Ca?olTna, Duke Univ. 
pfSis, 19391 ordan, H., J^sogiil Concepts a^^ 
Mind .' New York, King's Crown, 1945| Bates, . , 

"Tactors Related to Children's Understanding of Social 
concepts,- unpublished doctor's thesis. University of 
California, 1947. 

^^Wesley. Edgar a. and Stanley P. wronski, IfiaisMna |2ciai 
2t24d4fiA in iljISPiaiSafflfii* Boston. D. C. Heath S. Co, 
1958. 

22wesley. Edgar B.. -The We-ley Tests ^ social Tei^,- 

Truman L. Kelley and A. C Krey, ^^L'v^SS^QSfwfT- 
Bure jaents in felifiL^flfii'^i ScAfiDSfift^ New York, Scribner «, 
1934, 219-226. 
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of concept leanning at grade 3 aa being the result of a more 
deliberately planned social curriculum than in grade. 1 and 
2, Though I do not Know them, there may well have been many 
studies carried out during these years that weighed the 
relative merits of one method of teaching social concepts 
vs. another, as a variety of niore recent studies have done?^ 
Who, however, iias set out to teach social concepts to a 
criterion at a given age, i. e., to teach yatii the pupils 
reached the criterion, and in this way studied the methods 
that resulted in different children's learning at that age? 
Wte may o«ten teach with reference to a criterion, but in 
the regular or the experimental social studies or civics 
Classroom we typically abandon a unit of instruction, to 
move or. to another unit or to discontinue an experiment, 
while some pupils, at least, still have not met what we 
might hold as even a minimum criterion. Of course, this 
raises all kinds of tother questions, about the desirability 
Of convergent vs. divergent learnings, etc., but that is 
beside the point here. What I sense is that there are a 
variety of factors, perhaps especially in social studies 
and civics, that contribute to a ceiterion referenced sys- 
temls devolving into a norm referenced system. One of 
these factors is the very knowledge that individuals' dif- 
ferences with respect to attainment of a criterion held to 
i^Hreasonable" i2t « ^iven ag* wi ll tend to diminish as 

^^For references to these, see the annual reviews of re- 
search published in SfisAfil fi^aSAiA^ 'in^e 196». 
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motfe of these individuals attain the criterion Eagjfe. that age. 

Without understanding the iaaue coiaplete),]^ I l^hiaJS there 
is an ambiguity in National Assesamenfs own position on 
this Matter. On the on«,hknd, we have been told that ^'Out- 
standing local teachers familiar with each target age group 
(a««s 9, 13, 17, adult) worked for weeks with our staff to 
break down each general objective in the inost germane behav- 
iors appropriate as goals for a given age group. -24 on the 
other hand, we learn that OMtcriterion for exercise develop- 
ment was that "some exercises cover important attainments 
which nearly everyone is successfully achieving, some which 
very few people are achieving, and soMe which a middling num- 
ber achieve. -25 Does the latter aim, together with the find- 
ing that National Assessment performances did in fact break 
down this way for each major citizenship goal,^^ imply that 
such a distribution should continue to be obtained in future 
assessments? Perhaps the aim of National Assessment is to 
provide information that will encourage state and local 
striving toward full attainment of the goals for all indivi- 
duals. Taylor, however, WwcolMitnrWr • tendency for the 
National Assessment data to be treated as a national norm 

^^Campbell, Vincent N. and Daryl C Nichols, -National As sr< 
sesttment of Cttiasenship Education,** SfiSiai £d3ijSlii2n» 
March, 1968, p. 280. 

^'^Campbell, Report I, Citizenship i N^tionftjl Rfisults- 2E. cit., 
p. 5. 
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iljii., p. 6. 
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?;,<•?,> ^:..'v At -5^1-: inb botb. ^^^t^ .y>nd .loc«M U^^t pert* or'/wances arc bj»- 
iljii^* ' G.iv<9u tte sts.iti«tlcal patterns vdthin and 

b^S!tw«eN-ii <v.q& qro'j,P5'i fchH'.t ^'?:vfctoa.l Afss-essn^nt jSiodgflSj, X think 

The Niiiti c*?;i«..l A!«0(<>??^«ni^nt findings are liKttly to ba taKen 
£1?* d<*^^s3.op?*x•i^.t■T3,i n-i^jcr^s ssn.l^^ss s^Vi5sral 3t.spa to coimter this 
uir---! tij^SvAn'ii, (I) 'y>'te ey.€»rcx»es5 wO!.>ld hisivo to be brolcen down 
iinto their avo.?r« truly dsvtsiopsptsvit^l and noiidevslopinsntal 
ccivs^jonents , "i*!-.'? 'n3i?i'^>im^!nt of esj^srcisae?. to age levels 

^*«iil.d nse<t'^ to b*? wosi* the sataniApoiT^t of what it is 

tiifaosr'aitJxftXly p^^seibin 1-.Q ■e^qp'act any jjd'icatble individual of 
•J: qiv£-n lev«X to acb/ij^v-s., hna (3) expCi.risjiBnts -onjuld have to 
fcc coftnii-fct'fd -co d^wnatrate tMt 10Q% of the educable indi-^ 
viduale Hit mi iiJimXd aMte^ g&ccspt,able perforniances 

for the texssK'cisefT: st th^it Xevol* 

Thill? iB a .rather cSr^^it^tic prescription, with many prob- 
im^ inheriing in it. Ity fiaiict&on in thijs arguzaent its to 
vrndei-scos's th« ^'aict, s'^ace^tisied by NaUojial Assessment but 
likely to b€ ?y.-"*sr«l\ri'^;:>y^d by the pKueaodevelopHiental 
pattenm in its fim^kigSf that Nationfii Asseasoent so far 
has not triod to ta>r.9 cogrjizanoe of what haa in fact been 
<Jelib€'r.atej.y taught, epec:if iceilXy in the fjchooiei thus its 
findin^'is shcsild not be coMtrued as s'nggeating limits to 



^'ayior,. qi-t., « P. 20;, p. 25* 

^®£b*a mde the int«r®?iting cfooervation that the percen- 
'taqe »y8te^5 of gnMnq that prevail^iid 40 years ago and 
b^-fore was a criterion referenced system* He disc^jsses 
siaas of th« XQ&mna for its yielding to a noria refer- 
enced system in Ebel, Robert L., -Criterion Referenced 
MeaBttre»^ant3 1 Limitations," ^i^mi tekJi* 22» Febru- 
o »ry, 1971, 282-288. 
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tfhdt individuaia cc^u-d be taoqht-., or could learn, at the dif- 
ferent age levels of the sssessiif^ent . 

But we did admit that t^iis has its problems. One of 
thiese is di«tingaishing v?iat we called above more "truly" 
developitteiital from nondevelopavental components of learning. 
It seems to me, for example, that any 9 year old could learn 
that policeitten do not have the right of unrestricted entry 
to a home. At the same time, 9 year olda* reasons for such 
a belief would be less sophisticated than 13 year olds* rea- 
soiis. focusing at the first level on, perhaps, the more 
direct consequences to the p«B3ons involved, and at the 

:^ '"^^^^ qeneral properties of tlie social system like 
the rights of individuals to piivacy and t.ife e...c"tr of not 
regulating entry into hoiaes on other spheres of the social 
system. Instruction might then concentrate on all 9 year 
Olds attaining at least the first developmental level of 
justification, and on all 13 year olds attaining at least 
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criterion in citizenship is more validly held for individuals 

or for the society aa a whole. Consider the case fot the 

30 

latter standard first. Almond and Verba have sugge8i;ed 
that a political systwn might get overheated if too many of 
its citizens participated actively in the process of gover- 
nance, beyond voting » and thus that theee might be optimal 
levels of less t\mn full part icipat ion for the stability of 
even a democratic syatum of government. (Almond and Verba 
were, indeed, rationalizing the levels of participation they 
found in Ameiican society.) Apart from whether or not one 
agrees vith the value of stability in the system, this does 
lead one to distinguish between citizenship goals for the 
nation or for a region as a whole and goals for all the 
citizens of the nation or a region. Maybe only a few are 
needed to, for example, come up with many ways that war 
could be avoided or that diswsrimination in a park could be 
stopped. When Report 2 referred to "goals that only a se- 
lect few were achieving, •'^^ I wondered if a part of what 
this implied was that only a few are needed to achieve these 
goals. 

The trouble with this reasoning, however, i« that the 
many who do not achieve the goals in question may include 
pjraoiiBoiy those whose interests are most at stake, viz . , 
those most likely to be frontline soldiers in a war or most 
likely to be excluded from a park. Once we allow that less 
than all need to achieve one goal or another for the health 

^^Alroond, Gabriel A. and Sidney Verba, 2h£ SivAfi gMlt^mre, 
Boston, Little, Brown and Company, 1965. 

o . ^^Campbell, Report 2, 2E« cit . , p. 5. 
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Of the body politic as » whole, ve run the risk of playing in- 
to Ju«t those features of the system that presu«ibly account 
for some groups in the population being consistently -disad- 
vantaged" no natter what the goal in <riestion is. Further- 
more. i«ny of the goal, set by National Assessment pertain to 
the rights and obligations of individuals m. individuals, in 
their everyday relationships to one another and to the la*. 
Anyone of a relevant age who does not Xnow that the courts are 
available for the resolution of a dispute over money might be 
disadvantaged in the event of such a dispute. Similarly, 
anyone who discriminates against another on the basis of his 
or her group identif icfction contributes to the denial of the 
rights of the other to be treated as an individual. 

A third problem arises from the fact that, especially if. 
in line with the position advocated e.tlier. instruction with 
respect to a particular goal at a given age was pursued until 
jil individuals so instructed reached the goal criterion, 
there might not be ti«e enough to reach »11 the goals held to 
be desirable for individuals at that age. 

Still another prob»em is that it cannot be assumed that 
school is the most appropriate setting in which to intervene 
to try to bring individuals to a criterion. But then there 
is no way of Knowing from the present design of National As- 
sessment what part the schools have played in the performan- 
ces on almost any of the assessment exercises. Even specify- 
ing which criteria the schools could effect would be progress 
from this standpoint. Especially for those criteria that we 
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have charactMrized as "enactBftents , " it might be that school 
tfould have to be croordinated with other agencies or inatitu- 
tiona, family, local government, citizens groups, t*levision, 
and so on. National Assessment may assume that efforts of 
this sort will be an outgrowth of the publication of assess- 
ment results. It would be a more likely outcomi* if the 
contribution of such efforts to the attainment of goals was 
specified. 

What all of this reasoning drives me to, then, is a 
different kind of neutrality from that which is modeled by 
National Assess^nt, Instead of publishing results that en- 
courage normative thinking in the face of virtually no know- 
ledge of the conditions of individual citizenship learning 
find development, an alternative strategy should concentrate 
on specifying the conditions that make full attainment pos- 
sible for one or another criterion at a given age level. 
The freedom of state and local agencies or institutions to 
emphasize those goals that mattered most to them would thus 
be an enabling one, rather than the spurious freedom that 
sheer ignorance affords us. 

B. Parental C ducat ion > color, and Loc ation by bize an d 

i-vpe of community as Variables in Citiz enship Performancs. 

The logic with respect to these variables is essential- 
ly the same as it has been above, though I will be repeating 
it in somewhat different terms. First, let us attend again 
to the psycho-logic of the matter. The very familiarity of 
the National Assessment findings, especially with respect to 
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parental education, color, and location, may tend to give 
them a normative significance, i. e., to.iwply that the ob- 
tained patterns are what we should continue to expect. For 
we, at least, this stereotyping is reinforced by the tech- 
nique of conparing group performance levels with national 
levels, rather than with the criterion of 100%, so that 
there will aegulariy be groups with "advantages" and groups 
with "deficits", relative to each other (shades of norm 
referencing?), even when, say, it is 60% of one group and 
50% of the other that has reached a criterion. Be that as 
it may, the familiarity of the results that X am referring 
to is their comparability to the findings of any number of 
assessments, from the Army Alpha intelligence testing pro- 
gram that might be said to have started it all, to the 
Coleman Report and still more recent studies. The sheer 
accumulation of these findings has cont*ibuted to their re- 
ification in recent years, so that in the JencXs analysis 
socio-economic status and color appear to be almost intrac- 
table constraints on education, or at least on education by 
the schools. 

Let me focus this thinking in terms of the Coleman and 
JencKs analyses, raising a few questions at a very superfi- 
cial level. First, these studies base their (somewhat dif- 
fering) conclvisions about the limited capacities of school- 
ing to affect achievement on achievement defined in very 
close relation to general cognitive skill, with all tt tb» 
cultural loadings that the phrase "general cognitive skill" 
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implies. As Jencko hinwelf observes, the Coleman tests of 

Verbal Abtlity, Nonverbal Ability, Reading Comprehension, 

Mathematical Achievement, and General Information intercorre- 

lated 80 highly that "The student who did well on one test 
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and poorly on another was quite exceptional.- Assuming 
for the purposes of this argument that soccLo-economic and 
cultural factors reflected in the school will largely deter - 
mi.ne the school's effect on general cognitive skill, it 
remains possible that schooling can have a more independent 
effect in areas of achievement tkmt are more specific to 
school instruction and, conversely, less generally diffused 
in the society at large. The International Education 
Assessment's current research on factors affecting achieve- 
nent suggest, for example, that the effectiveness of science 
instruction is substantially more independent of non-school 
factor* than is the effectiveness of instructicn in reading* 
or arith»etic,^^ Pursuing the principle that might explain 
this, we first have to acco?,mt for finding that their 

social Studies -Civics Education test results behave more 
like reading and arithmetic than like science: 

The lEA researchers themselves attribute their finding 
to the permeation of citizenship knowledge, like the 3 R's, 
throughout life outside the schools. It makes sense from 
this standpoint that the citizenship results would reflect 

^^Jencks, Christopher gfe ftl. Inequality . New York, Basic 
Books, 1972, p. 55. 

^^•^Scholars Weigh Education Data from' Twenty Countries," 
R eport £31 Education Research, S, Decemlaer 5, 1973, 
pp. 3-4. 
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varying access to» and occasion or power to use, the know- 
ledge tti&t the tests incorporate. But is not sci«i»ce also 
diffused throughout life in a modem society? 0.' course 
this is the case. One must reason then that science educa- 
tion 1 the science t«8t exercises have been couched at a 
higher or more specialized level of Knowledge chan is 
reflected in every day life, and that citizenship education 
and/or the citizenship test exercises have not been defined 
at the aame relatively high or specialized level. Studies 
of the learning of higher mathematics, as opposed to the 
camiwm mathematics the Coleman (re-analyzed by Jencks) and 

lEA /studies were conceriied with^ do show that differences 
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in schooling make a difference. What is needed, then, is 
to demonstrate a similar effect in citizenship. 

What might be meant by "higher" or "more specialized" 
citizenship knowledge? One need not think of it simply as, 
say, secondary school or college level information and con- 
cepts, but rather as knowledge that is couched at a higher 
or more co^i^plsx level than vhich seems to be reflected in 
citizenship achievement at any given age under conditions 
other than systematic instruction. Thus one would aim to 
teach at a given age what National Assessment or some other 
survey shows is not "normally" achieved tit that age^ or 
perhaps not even at a subsequent age. 

Another, complementary way of construing what might be 
meant by higher or more specialized citizenship knowledge 



Dyer* Hentry, 



BEST COPY hmma 

27 

stresses, instead of official or ideological doctrine, a 
more skeptical, probinq interpretation of citizenship. Nei- 
ther National Assessment nor lEA has included taiowledqe 
exercises of this sort, although the lEA instruments do 
include attitude or opinion items that question the economic 
and political systems of the soc44ty. Can we say that the 
schools should also Urn to teach to individuals of a given 
social background that which is not ♦'normally" known to 
persons of that backgoound in our society, be they rich or 
poor, and should Cultivate qfuestioning in that social sector 
of a sort not "normally realized in that sector? 

Arnoff '8^^ investigation of factors related to the abi- 
lity of children in grades two. three, and four to compre-^ 
hend concepts of government points in the first direction 
suggested above. Arnoff designed a 5 week government curri- 
culum to include (though not exclusively) concepts not 
ordinarily included in instruction for these grades, i. e.. 
not included in social studies textbooks at these grade 
levels. Arnoff 's results clearly showed the effect of in- 
struction. 75% or more of second graders, for example » 
learned 23 new concepts of local, state, naticnal. and gene- 
ral govemmentt property tax, split ticket, subpoena, 
judge, etc.. most of which were not included in second grade 
social studies textbooks. Furthermore, social class tended 
not to correlate with more or less learning of new concepts 

^^Annoff.'htelvin. "An Investigation of j;actors Related to 
the Ability of Children in Grades Two. Three, and Four 
to comprehend Concepts of Government.- doctoral dis- 
sertation, Ohio University, 1963. 
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in this experiment, though mental age as defined by an in- 
telligence test did correlate with new learning. 

A field trial of the American Political Behavior course 
developed by the High School Curriculum Center in Government 
at Indiana Univeraity^^ points partly in the second direc- 
tion indicated above. The APB course aimed to teach "facts 
and ideas about politics that have not been part of typical 
social studies curricula,** for example, facts about the 
proportions of different income groups that vote in Arnerican 
elections. Differences between experimental and control 
groups' pre -test/post-test Knowledge gains were clearly dem- 
onstrated in all 9 communities involved in the field trial. 
On the other hand, comparable differences in^political sci- 
ence skills achievement were demonstrated in only 4 of the 9 
contmL.ities, and effefcts on students' attitudes were demon- 
strated in none of these communities. Furthermore, while 
there was some variation of student background characteris- 
tics, the communities involved did not include the rural and 
inner-city extremes identified in National Assessment, and 
Almost all of the students were white. 

One should not suppose that systematic instruction 
could eliminate the effects of population or student back- 
ground cliar«ct«*istic», or indeed that this adequately 
represents what is desirable. The effects that National 
Assessment makes us principally aware of are those that stem 

36pa4.*.4nTc John J.. "The Impact of an Experimer*tal Course. 
"^^^'ASSricSn PoilticSl BXvior,' on the Knowledge, Skills, 
and Attitudes of Secondary School Students," Social 
Education , 2i, February, 1972, 168-179. 
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from rpstrictions on different qroups* access to and control 
of information! if citizenship education should aim to mini- 
mize these effects, still this would surely entail interven- 
tions outside the schools, and research and demonstration 
would need to be directed this way as well. At the same 
time, the schools must recognize the identities and priori- 
ties of different social Qcoups, and, paradoxically, what- 
ever equalization the schools accomplished with respect to 
the distribution of information and skills might contribute 
in some ways to heightened affective differences between 
groups . 

A second problem in the Coleman study, one that the 
Jencks analysis only partially rectifies and that National 
Assessment simply ignores, is the question of comparability 
of school environments, in other than SES terms, between 
and within different locations. It is well known that 
Coleman compared whole systems as to library ni«e» p^rpapil 
expenditure, level of teachers' formal education, and so 
forth, whereas these conditions might well vary between 
schools within a sy«tem. Jencks used Project Talent data 
to make these comparisons between individual high schools, 
and still obtained no effect independent of non-school fac- 
tors. The lEA science findings do show such an effect, not 
for all the variables that might be thought to be relevant, 
but for "the opportunity to learn, the student time in 
hours per week and cumulative years, the curriculum empha- 
sis, and the additional years of post -secondary preparation 
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of teachers."^® In none of these analyses has classroom 
climate or methodology seemed to account for differences in 
students* achievement. 

My own position is that one must compare not just pro- 
grams, or schools, or dven classrooms, in order to specify 
the environmental conditions that affect schooling's con- 
tribution to achievement. Rather, it is necessary to exam- 
ine different settings within classrooms, or within school- 
related locations outside the classroom, in order to make 
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headway with the question of educational environments. 
In my approach to this problem over the past few years, I 
h«^e found it useful to distinguish between high teacher 
control, joint teacher and learaer control, and high learn- 
er control of each of various conditions within one or 
another classroom setting (or subeetting), and thus to be 
able to ask how ^ch time the students in a given classroom 
spend under different cowlitions of control. Task options, 
pacing, teacher -learner and learner -learner interaction, 
teacher adaptiveness , and task performance criteria, are 
some of the conditions of settings that can be observed to 
vary with respect to control, so called "open classrooms", 
for example, can be seen to vary among themselves in the 
proportions of time that students spend under these differ- 
ent conditions of control, whether one is comparing time 

^^-Scholars Must Weight Education Data from Twenty Coun«* 
tries," OE. jd^t., P. 3. 

^^Grannis, Joseph C, Columbia Classroom Environments P£2- 
^ ms^^^ OEC.0.71.0593, Teachers 

College, Coluffila University, February, 1973. 
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for aggregates of pitiudents between two or more classrooms, 
or is comparing time for individual pupils within a single 
classroom. 

This approach further distinguishes between different 
tgrpes (l6natfut|it4onal purposes the transmission of Knowledge* 
tradition, and experience to all leaoners in a setting 
aliXet the operationalization of partly common, but also 
partly individuated, competencies or skills and concepts} 
and the cultivation of individual and collaborative venture, 
or exploration, problem solving, and expressive composition 
or construction. Intellectual, social, physical, and emo- 
tional aspects of leaoning and development are equally 
involved in each of these categories of purposes, 

I have hypothesized both that the effectiveness of an 
educational setting will be partially dependent on the 
internal consistency or congruency of its controls, and that 
each broad type of educational puppose will be realized best 
in a different type of setting, viz., transmission in a 
high teacher control setting, operationalization in a joint 
teacher and learner control setting, and venture in a high 
learner control setting. It is apparent, then, that I 
beli*ve that what has variously been called "classroom cli- 
mate" or ••classroom method" will someday be understood to 
relate to achievement, or to type of achievement, even 
though the results of research on this to date have been ve- 
ry confusing. 

This paper has emphasized education in the schools. 
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but it has recognized at morethan one junctmr^:- above that 
qoing beyond learner or citizen population va^ables to the 
interactions of individuals with their environments would 
entail research and demonstration outside of the school as 
well. What are the effects on individuals* acknowledgement 
Of racial discrimination, of this acXnowledgemenfs actual- 
ly contributing or not to ameliorating the discrimination? 
How is one*, orientation to a legal system for settling an 
argument over money affected by one* s having, or anticipat- 
ing having, money enough to invoke the legal system in a 
dispute? Does involvement in the affairs of a responsive 
public agency or institution »ead to greater participation 
in other public or community affairs? 

My paradigm for these questions, and many more, is 
Kohn*s^^ research on the conditions that determine fathers* 
values for their children. Social class, defined as occu- 
pational position and education, does relate in Kohn*s data 
to whether parents tend to value self -direct ion or conform- 
ity to external authority, higher social class being assoc- 
iated more with the first, and lower social class more with 
the second of these value clusters. When the analysis con- 
trols for the degree of self-direction or autonomy that the 
fathers experience at work, however, social class differen- 
ces tend to vanish, lower class fathers who experience 
autonomy in their jobs valuing auton omy for their children 

^^Kohn. Melvln L,, gkMS Confonnitsr. Homewood. Dorsey 
Press. 1969. 
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as ntuch as middle class fathers who experience this autonomy 
do. in other words, while social class is an approximation 
to the conditions that determine fathers* values for their 
children, the experience of fathers in their wor¥ describes 
these conditions more exactly. Is it not possible that 
research could similarly tracX down conditions associated 
with, but still independent of sex, parental education, 
color, and location, that would more exactly explain the 
associations of citizenship achievement with these variables? 
Further research could then be directed toward changing 
these conditions experimentally, so that, just as we might 
denonstrate in what way achievement other than tliat which is 
"normally" associated with different age levels is possible, 
likewise we could show how achievement other than that 
"normally" associated with different sex, parental education, 
color, and location statuses is possible. 

Ill, An / yitemative to the Nation al Assessment t>odel.. 

From various directions, our argument converges on the 
desirability of enphasizing person-environment interactions, 
and demonstrating the achievement that is possible under 
varying per son -environment conditions. Consider one further 
vantagepoitxt that differs somewhat from ours so far. 
Etzioni,"*^ in a discussion of organizational analysis, cri- 
ticizes that assessment of organizations which focuses on 
goal attainment. "One of the major shortcomings of the goal 
model is that it freq\iently makes the studies » findings 
stereotyped as well as dependent on the model's assumption!?" 
^ o '^^Etzioni, Amatai, "Two Approaches to Organizational Anaiy- 
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An organization frequently does not reach its qoals effec- 
tively, and often has goals other than the ones it claims to 
have. It would be more useful. Etzioni concludes, to treat 
qoals as cultural entities in themselves, and to ask how 
various internal and external conditions contribute to the 
realization of observed goals. 

I do think National Assessment's attempt to define 
citizenship goals and to describe performances that repre- 
sent the achievement of these goals is valuable. The fact 
that National Assessment anticipates modifying the goals 
and exercises to reflect changes in priorities between 
assessnient administrations indicates at least some awareness 
of the goals as "cultural entities. But what is served by 
publishing only those statements of goals that represent 
the "consensus" of those consulted? Would not the publica- 
tion of disagreements over the definition of goals, particu- 
larly disagreements stemming from different ^ubcultural 
interpretations of citizenship, add further to the de-mythi- 
fication and de-stereotyping of citizenship qoals? 

What stands in the way of this process is. once again, 
the National Assessment model, its stru^.t^ure and asaumptions, 
Let me claim intuitively that a national test of citizenship 
simply cannot be consistent with cultural and political 
ploralism. National Assessment is first and foremost a test 
and as such depends upon coiif<btfdty to its goals for its 
authority. 

An alternative to National Assessment would conduct 
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research and demonstratiian in specific relation to citizen- 
ship goals, but would recognize that these goals have dif- 
ferent meaniii§« and priorities for different individuals 
and groups. The alternative should » indeed, explore these 
differences explicitly, as an understanding of them would 
be essential to any application of the research and demon- 
stration. 

What I hav* in mind first of all, then, is a pluralism 
of inquiries to replace the monolithic Nat:ional Assessment, 
inquiries tlwt could be drawn upon differently l>y different 
agencies or groups, or rather, since anything can be drawn 
upon in this way up to a point, that encouraged different 
agencies or groups to odA4k their effopts according to what 
is most meaningful and important to them. 

An alternative to National Assessment should be truly 
criterion oriented. Its aim should be to use analysis and 
intervention to bring the observation of performances as 
close as possible to criterion, fillowing that different 
agencies and groups will draw differently on this research 
and demonstration in subsequent applications of it. 

Steyha«iwiriitie studies would be involved, but their in- 
tent would h4 the same. The basic paradigm would be that 
which shows converqence on the achievement of goals as the 
result of reducing differences between groups, or aggre-* 
gates, of different statuses, by specifying the conditions 
associated with these statuses that ocAginally account for 
the differences in goal athaftvomeht • Is the seemingly 
lesser awareness of racial discrimination on th» part of 
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Blacks a result of unwillingness to disclose this awareness 
in a test or interview? Then perhaps the difference would 
diminish as observations were conducted in settings in which 
the respondents felt more in control. Are parents of lesser 
educational attainment less involved in the politics of 
their chladc«ii*s schools because of a feeling that school 
had not been responsive to them as children? Comparing 
groups on the basis of this feeling might reduce the differ- 
ence attributable to status > and intervention through the 
schools to respond to alienated parents might increase the 
parents • involvement in their children's schools. 

Probably hundred^ of studies that throw light on the 
specific conditions contributing to citizenship have already 
been reported, Th»se could be indexed by goals, and again 
by conditions I, so as to make this knowledge available to 
policy makers at different levels, somewhat in example of 
this is a docunent prepared by the Social Research Group at 
The George Washington University, Repfiftf^^ Problems and 
issues in th£ ^fia o£ Socialization. 1972, part of which 
analyzes what is known about the development, the determi- 
nants, and the changing of intergroup and intragroup atti- 
tudes and behaviors. Of course, such an analysis points as 
well to what is ngt known. The following quotation from 
the Social Research Group's report repr&2Pnt« a juncture 
that is frequently arrived at in th«ir analysis » 

The significance of some of th?se findings on coopera- 
tion is far from clear. We still do not know how coopera- 
tion determines intergroup attitudes and behaviors or its 
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2ole as a factor in achieving a successful ethnic and social 
class mix. What does seem clear from the research is that 
cooperation sometimecr leads to better mtergroup relations, 
although «uch work is needed to determine the conditi^^s 
under which cooperation produces an enhancing effect. 

Much work does need to be done. Some of it consists 
of formal stisdies in which the investigator attempts to con- 
trol the principal variables and to predict outcomes pre«- 
ciseiy in advance. Often, however, these studies are too 
rigid to be able to deal with the unintended factors that 
enter into every complex action— which may partly account 
for formal studies' failing to confirm their hypotheses. 
Action research, in which the action is typically guided by 
more evolutionary goals, and in which "real time feedback" 
continuously regulates the participants' activity in rela- 
tion to goals, compensates £n flexibility for what it may 
lose in control. A formidable agenda of both formal and 
action studies, then, must be undertaken, all of it referen- 
ced with respect to goals and conditions alike. 

Perhaps the case could be made that developing a know- 
ledge base for citizenship education in this way would still 
require a determination of national performance levels as in 
National Assessment. In my opinion, however, this woiiild be 
distracting at the least,, and possibly destructive. An 
alternative way of construing the "natiaial" significance of 
a study would be that it deals with problems that are best 

"^^sowder, Barbara J. and Joyce B. Lazar, R£8£a|Sll . 

yid issues in fellfi Area 2i SogiaUz^tion., Social Research 
Group, The George Washington University, Washington 
D.C., 1972, p. 82. 
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approached with national resources, while a more local study 
deals with problems for which local resources are adequate, 
or, to put it differently, for which onli local resources are 
likely to be appropriate. Thus a study could have national 
significance even if it did not have a national sample 
(which is not the same as sayinq it would not be carried out 
in a variety of communities). The effects of income mainten- 
ance on citizenship performance might be construed as a 
national question because only the federal government has the 
money to maintain incomes. The effects on citizenship per- 
formance of collaboration between schools and other community 
institutiais or agencies might be construed as a local ques- 
tion because only local individuals or groups have the power 
to brinq about this collaboration. 

Clearly a citizenship research and demonstration program 
could go on forever, in so far as our awareness of what we 
do not Know multiplies at the same rate, at least, as does 
our imowledge. But then National Assessment equally could 
continue forever, since the goals it sets will probably 
change in like manner. Substantial human and material re- 
sources have been invested in National Assessment, but this 
is not the only, or even the chief reason, to think that 
National Assessment win ^ continued. The technology of 
National Assessment, as of testing more generally, peculiarly 
lends itself to the collusion of academic ingenuity and poli- 
tical decision making. Were the questions this paper raises 
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foreseen? Probably some of them were, and others were not. 
If the present forn. of National Assessment is itself the 
result Of compromises »^ant to render the project less dan- 
gerous politically, this does not bode too well for the 
alternative that I propose. On the other hand, what are 
the political consequences of what National Assessment hath 
wrought? Thesie too will have to enter into the equation. 



